An Investigation of Reading Development Through Sensitivity to Sublexical Units

The present dissertation provides a novel perspective to the study of reading, focusing on sensitivity to sublexical units across reading development. Work towards this thesis has been conducted at SISSA and Macquarie University. The first study is an eye tracking experiment on natural reading, with 140 developing readers and 33 adult participants, who silently read multiline passages from story books in Italian. A developmental database of eye tracking during natural reading was created, filling a gap in the literature. We replicated well-documented developmental trends of reading behavior (e.g., reading rate and skipping rate increasing with age) and effects of word length and frequency on eye tracking measures. The second study, in collaboration with Dr Jon Carr, is a methodological paper presenting algorithms for accuracy enhancement of eye tracking recordings in multiline reading. Using the above-mentioned dataset and computational simulations, we assessed the performance of several algorithms (including two novel methods that we proposed) on the correction of vertical drift, the progressive displacement of fixation registrations on the vertical axis over time. We provided guidance for eye tracking researchers in the application of these methods, and one of the novel algorithms (based on Dynamic Time Warping) proved particularly promising in realigning fixations, especially in child recordings. This manuscript has recently been accepted for publication in Behavior Research Methods. In the third study, I examined sensitivity to statistical regularities in letter co-occurrence throughout reading development, by analysing the effects of n-gram frequency metrics on eye-tracking measures. To this end, the EyeReadIt eye-tracking corpus (presented in the first study) was used. Our results suggest that n-gram frequency effects (in particular related to maximum/average frequency metrics) are present even in developing readers, suggesting that sensitivity to sublexical orthographic regularities in reading is present as soon as the developing reading system can pick it up \u2013 in the case of this study, as early as in third grade. The results bear relevant implications for extant theories of learning to read, which largely overlook the contribution of statistical learning to reading acquisition. The fourth study is a magnetoencephalography experiment conducted at Macquarie University, in collaboration with Dr Lisi Beyersmann, Prof Paul Sowman, and Prof Anne Castles, on 28 adults and 17 children (5th and 6th grade). We investigated selective neural responses to morphemes at different stages of reading development, using Fast Periodic Visual Stimulation (FPVS) combined with an oddball design. Participants were presented with rapid sequences (6 Hz) of pseudoword combinations of stem/nonstem and suffix/nonsuffix components. Interleaved in this stream, oddball stimuli appeared periodically every 5 items (1.2 Hz) and were specifically designed to examine stem or suffix detection (e.g., stem+suffix oddballs, such as softity, were embedded in a sequence of nonstem+suffix base items, such as terpity). We predicted that neural responses at the oddball stimulation frequency (1.2 Hz) would reflect the detection of morphemes in the oddball stimuli. Sensor-level analysis revealed a selective response in a left occipito-temporal region of interest when the oddball stimuli were fully decomposable pseudowords. This response emerged for adults and children alike, showing that automatic morpheme identification occurs at relatively early stages of reading development, in line with major accounts of morphological decomposition. Critically, these findings also suggest that morpheme identification is modulated by the context in which the morphemes appear

Algorithms for the automated correction of vertical drift in eye-tracking data

A common problem in eye tracking research is vertical drift\u2014the progressive displacement of fixation registrations on the vertical axis that results from a gradual loss of eye tracker calibration over time. This is particularly problematic in experiments that involve the reading of multiline passages, where it is critical that fixations on one line are not erroneously recorded on an adjacent line. Correction is often performed manually by the researcher, but this process is tedious, time-consuming, and prone to error and inconsistency. Various methods have previously been proposed for the automated, post-hoc correction of vertical drift in reading data, but these methods vary greatly, not just in terms of the algorithmic principles on which they are based, but also in terms of their availability, documentation, implementation languages, and so forth. Furthermore, these methods have largely been developed in isolation with little attempt to systematically evaluate them, meaning that drift correction techniques are moving forward blindly. We document ten major algorithms, including two that are novel to this paper, and evaluate them using both simulated and natural eye tracking data. Our results suggest that a method based on dynamic time warping offers great promise, but we also find that some algorithms are better suited than others to particular types of drift phenomena and reading behavior, allowing us to offer evidence-based advice on algorithm selection

Situating language register across the ages, languages, modalities, and cultural aspects: Evidence from complementary methods

In the present review paper by members of the collaborative research center “Register: Language Users' Knowledge of Situational-Functional Variation” (CRC 1412), we assess the pervasiveness of register phenomena across different time periods, languages, modalities, and cultures. We define “register” as recurring variation in language use depending on the function of language and on the social situation. Informed by rich data, we aim to better understand and model the knowledge involved in situation- and function-based use of language register. In order to achieve this goal, we are using complementary methods and measures. In the review, we start by clarifying the concept of “register”, by reviewing the state of the art, and by setting out our methods and modeling goals. Against this background, we discuss three key challenges, two at the methodological level and one at the theoretical level: (1) To better uncover registers in text and spoken corpora, we propose changes to established analytical approaches. (2) To tease apart between-subject variability from the linguistic variability at issue (intra-individual situation-based register variability), we use within-subject designs and the modeling of individuals' social, language, and educational background. (3) We highlight a gap in cognitive modeling, viz. modeling the mental representations of register (processing), and present our first attempts at filling this gap. We argue that the targeted use of multiple complementary methods and measures supports investigating the pervasiveness of register phenomena and yields comprehensive insights into the cross-methodological robustness of register-related language variability. These comprehensive insights in turn provide a solid foundation for associated cognitive modeling.Peer Reviewe

Form and Function: A Study on the Distribution of the Inflectional Endings in Italian Nouns and Adjectives

Inflectional values, such as singular and plural, sustain agreement relations between constituents in sentences, allowing sentence parsing and prediction in online processing. Ideally, these processes would be facilitated by a consistent and transparent correspondence between the inflectional values and their form: for example, the value of plural should always be expressed by the same ending, and that ending should only express plural. Experimental research reports higher processing costs in the presence of a non-transparent relation between forms and values. While this effect was found in several languages, and typological research shows that consistency is far from common in morphological paradigms, it is still somewhat difficult to precisely quantify the transparency degree of the inflected forms. Furthermore, to date, no accounts have quantified the transparency in inflection with regard to the declensional classes and the extent to which it is expressed across different parts of speech, depending on whether these act as controllers of the agreement (e.g., nouns) or as targets (e.g., adjectives). We present a case study on Italian, a language that marks gender and number features in nouns and adjectives. This work provides measures of the distribution of forms in the noun and adjective inflection in Italian, and quantifies the degree of form-value transparency with respect to inflectional endings and declensional classes. In order to obtain these measures, we built Flex It, a dedicated large-scale database of inflectional morphology of Italian, and made it available, in order to sustain further theoretical and empirical research

(How) Do Register and Morphosyntactic Congruence Effects Interact during Sentence Reading? Two Eye-Tracking Pilot Studies

In two eye-tracking pilots during reading, we investigated real-time processing of formality-register congruence and subject-verb morphosyntactic congruence, and their relation. Participants read, in German, two context sentences conveying a formal or informal situation, followed by a target sentence containing a high- or low-register verb (e.g., Engl. transl. "The policeman detained the activist" vs. "The policeman grabbed the activist") which matched or mismatched context formality. The second pilot additionally manipulated subject-verb morphosyntactic congruence (e.g., Engl. transl. "*The policeman detain the activist"; "*The policeman grabbed the activist"). We observed main effects of formality-register and morphosyntactic congruence on verb reading times, as well as an interaction effect at the post-verbal object noun. Higher degrees of context and target sentence formality resulted in longer reading times. Ongoing investigation will further clarify our pilot findings, which suggest some interference between formality-register and morphosyntactic congruence processing